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The MAILING DATE of this communication appears on the cover sheet with the correspondence address » 
Period for Reply 



A SHORTENED STATUTORY PERIOD FOR REPLY IS SET TO EXPIRE 3 MONTH(S) FROM 
THE MAILING DATE OF THIS COMMUNICATION. 

- Extensions of time may be available under the provisions of 37 CFR 1 .136(a). In no event, however, may a reply be timely filed 
after SIX (6) MONTHS from the mailing date of this communication. 

- If the period for reply specified above is less than thirty (30) days, a reply within the statutory minimum of thirty (30) days will be considered timely. 
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- Failure to reply within the set or extended period for reply will, by statute, cause the application to become ABANDONED (35 LLS.C. § 1 33). 
Any reply received by the Office later than three months after the mailing date of this communication, even if timely filed, may reduce any 
earned patent term adjustment. See 37 CFR 1 .704(b). 
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2a)Q This action is FINAL. 2b)S This action is non-final. 

3) D Since this application is in condition for allowance except for formal matters, prosecution as to the merits is 

closed in accordance with the practice under Ex parte Quayle, 1 935 CD. 1 1 , 453 O.G. 21 3. 
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4) ^ Claim(s) 1-88 is/are pending in the application. 
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5) Q Claim(s) is/are allowed. 

6) ^ C\a\m(s) 1J}8 is/are rejected. 
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8) D Claim(s) are subject to restriction and/or election requirement. 

Application Papers 
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10)D The drawing(s) filed on is/are: a)Q accepted or b)D objected to by the Examiner. 

Applicant may not request that any objection to the drawing(s) be held in abeyance. See 37 CFR 1 .85(a). 

Replacement drawing sheet(s) including the correction is required if the drawing(s) is objected to. See 37 CFR 1.121(d). 
1 !)□ The oath or declaration is objected to by the Examiner. Note the attached Office Action or form PTO-152. 
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DETAILED ACTION 



Response to Arguments 



1. Applicants arguments, see page 2, lines 19- 25, page 3, lines 1- 5, filed on Feb 
27, 2004, with respect to claims 1-88 have been fully considered but they are not 
persuasive. 



2. The following is a quotation of the first paragraph of 35 U.S.C. 1 1 2: 



The specification shall contain a written description of the invention, and of the 
manner and process of making and using it, in such full, clear, concise, and exact 
terms as to enable any person skilled in the art to which it pertains, or with which it is 
most nearly connected, to make and use the same and shall set forth the best mode 
contemplated by the inventor of carrying out his invention. 



Claims 1-88, are rejected under 35 U.S.C. 112, first paragraph, as containing 
subject matter which was not described in the specification in such a way as to enable 
one skilled in the art to which it pertains, or with which it is most nearly connected, to 
make and /or use the invention. 

Regarding claims 1 - 88, the specification does not clearly explain the following 
elements as noted below. 

In claim 1 , how a sensor is used to obtain at least two differing views. The 
specification, on page 1 1 fig 1 A shows the apparatus obtains bottom image 50 by 
camera 10 and On page 12, fig 1B shows the apparatus obtains an image of a pair of 
side perspective views by camera 15 receive an image 60. The examiner does not 
understand how " a single sensor is being used to obtain at least two different views 



Claim Rejections - 35 USC §112 
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Applicant needs to point out in the specification how or where a single sensor is being 
used. Fig 1A shows two views being obtained, each view obtained by a different sensor. 
Please explain. 

3. In the remark, applicants have argued in substance that 

1 . Liu reference nor none of the prior art do not teach or suggest that a sensor 
be used to obtain at least two differing views. Liu reference shows two views being 
obtained, each view obtained by a different sensor. 

In the reply, the examiner states the following. 

As to point 1 , with respect to the art rejection, the examiner has carefully 
considered applicant's argument, but firmly believes the cited reference to reasonably 
and properly meet the claimed limitation. The examiner does not agree with the remarks 
that Liu cannot be said to suggest a sensor be used to obtain at least two different 
views. Liu reference meets the claim limitation. Claim language does not recite a sensor 
be used to obtain at least two different views. However, applicant is reminded that the 
claim language is given its broadest reasonable interpretation as to any sensor or a 
single sensor or same sensor is used. Therefore, Liu reference shows two views being 
obtained, each view obtained by a different sensor, (see column 4, lines 6-29). 
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DETAILED ACTION 



Claim Rejections - 35 U.S.C. § 103 



1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

This application currently names joint inventors. In considering patentability of 
the claims under 35 U.S.C. 103(a), the examiner presumes that the subject matter of 
the various claims was commonly owned at the time any inventions covered therein 
were made absent any evidence to the contrary. Applicant is advised of the obligation 
under 37 CFR 1 .56 to point out the inventor and invention dates of each claim that was 
not commonly owned at the time a later invention was made in order for the examiner to 
consider the applicability of 35 U.S.C. 103© and potential 35 U.S.C. 102(f) or (g) prior art 
under 35 U.S.C. 103(a). 

Claims 1-7, 9-29, 34- 43, 45-53, 56-60, 62-79, 81- 88, are rejected under 35 
U.S.C. 103(a) as being unpatentable over Liu et al. (US.5,859,924) in view of Shenghua 
Ye et al. " Vision -based system calibration for dimensional inspection ". 
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As per claim 1 , Liu discloses a three dimensional inspection method for 
inspecting ball array devices having a plurality of balls, wherein the ball array device is 
positioned in an optical system, the inspection method comprising the steps of: 

a) illuminating at least one ball on the ball array device (column 2, lines 59- 63); 

b) disposing a sensor, a first optical element (fig 3, item 308) and a second 
optical element in relation to the ball array device (fig 3, item 304), so that the sensor 
obtains at least two differing views of the at least one ball, the sensor providing an 
output representing the at least two differing views (column 4, lines 6- 29); and 

Regarding claim 1 Liu discloses method and system for measuring object 
features. The invention is directed to simultaneously collecting three-dimensional and 
two- dimensional data concerning features of an object and determines the dimension 
and relative positions of the features. Liu is silent about specific details of processing 
the output using a triangulation method to calculate a three dimensional position of the 
at least one ball with reference to a pre-calculate calibration plane. However, Shenghua 
Ye et al. discloses Vision -based system calibration for dimensional inspection The 
system comprises of: 

c) processing the output using a triangulation method to calculate a three 
dimensional position of the at least one ball with reference to a pre-calculate calibration 
plane (page 731 page 731- 732, paragraph 1,2 system description and calibration 
model and paragraph 3, calibration and measurement experiments), use of processing 
the output using a triangulation method to calculate a three dimensional position of the 
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at least one ball with reference to a pre-calculate calibration plane because to produce 
reasonable accuracy in 3-D inspection page 731, abstract paragraph ) . 

Therefore, it would have been obvious to one with ordinary skill in the art at the 
time of invention to incorporate the teaching the step of using processing the output 
using a triangulation method to calculate a three dimensional position of the at least one 
ball with reference to a pre-calculate calibration plane as taught by Shenghua Ye et al 's 
into the system of Liu because one with ordinary skill in the art would realize that this 
modification would produce reasonable accuracy in 3-D inspection, as suggested by 
Shenghua at et. ( Page 731 , abstract paragraph ). 

As per claims 2 - 4, 25 - 27,49, 50 and 72, Shenghua at et discloses the three 
dimensional inspection method wherein the pre-calculated calibration plane comprises a 
coordinate system having X, Y and Z axes and wherein a X measurement value is 
proportional to a Z measurement value (page 731- 732, paragraph 2 system description 
and calibration model and paragraph 3, calibration and measurement experiments ). 

As per claims 5, 73, 83 -86, Liu discloses the three dimensional inspection 
method wherein the triangulation method is based on determining a center (column 3, 
lines 14- 32) of the ball in a first view and determining a ball top location in a second 
view (column 2, lines 64- 67, column 4, lines 6-26, 61-63). 

As to claims 6, 28, 51 and 74, Shenghua at et discloses the three-dimensional 
inspection method wherein the pre-calculated calibration plane is defined by measuring 
a calibration pattern (page 731- 732). 
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As per claims 7, 29, 60, 75 Liu discloses the three-dimensional inspection 
method wherein the second optical element comprises a mirror (column 8, lines 28- 37). 

As per claims 9 and 76, Shenghua at et discloses the three dimensional 
inspection method of claim 1 , wherein one of the at least two differing views is obtained 
at low angle of view (page 732- 733, fig 5). 

As per claims 1 1 , 34, 58, 63, 78 and 88 Shenghua at et discloses the three 
dimensional inspection method wherein the sensor comprises a charged coupled device 
array (fig 1 ). 

As per claim 12, 35 and 59 Liu discloses the three dimensional inspection 
method wherein the sensor comprises a complementary metal oxide semiconductor 
device array (note, any sensor devices would comprises of a detection system which 
are made up of many metal oxide semiconductor array. These detection devices such 
as sensors has a characteristics and can be considered as a common feature of any 
such devices, column 2, lines 49- 58). 

As per claims 13, 38, 52 and 79 Liu discloses the three dimensional inspection 
method wherein the processing step further includes the step of applying gray scale 
edge detection to locate ball positions (column 3, lines 14- 32). 

As per claims 14, 39, 53 and 87, Liu discloses the three dimensional (column 9, 
lines 6- 12) inspection method wherein the processing step further includes the step of 
applying threshold analysis (column 5, lines 38- 61 ) 

As per claims 15, 40 and 65 Liu discloses three dimensional inspection method 
wherein the first optical comprises a lens (fig 3, column 8, lines 25- 31 ). 
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As per claims 16, 41 and 66 Liu the three dimensional inspection method 
wherein the first optical element comprises a pin-hole lens, (note, optical system 
inherent has pin-hole lens, fig 3 column 8, lines 30- 37). 

As per claims 17, 42 and 67 Liu discloses the three dimensional inspection 
method wherein the first optical element comprises a plurality of lens elements, (note, 
optical system has plurality of lens, column 8, lines 21- 36). 

As per claims 18, 43 and 68, Liu the three dimensional inspection method 
wherein the first optical element comprises a telecentric lens, (note, optical system 
inherent has telecentric of lens, column 18, lines 34- 37). 

As per claims 19, 36,56 and 81 Liu disclose the three dimensional inspection 
method wherein the ball array devices comprise ball grid array devices (note solder ball 
or bump is considered as ball grid array, column 3, lines 16-19, column 5, lines 18-19, 
column 6, lines 40- 42). 

As per claims 20, 37, 57 and 82 Liu discloses the three dimensional inspection 
method wherein the array devices comprise bump on wafer devices (note solder ball or 
bump is considered as ball grid array, column 3, lines 16-19, column 5, lines 18-19, 
column 6, lines 40- 42). 

As per claims 21, 46 and 64 Liu discloses the three dimensional inspection 
method wherein the step of processing the output is carried out on a personal computer, 
(note, optical system inherently has a processor and computer, column 7, lines 43- 48). 

As per claims 22 and 45 Liu discloses the three dimensional inspection method 
wherein the sensor includes a solid state sensor array (column 2, lines 57- 58). 
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As per claims 23, 47, 62 and 71 Liu discloses the three dimensional inspection 
method wherein one of the views comprises a segment having a crescent shape 
(column 2, lines 10- 22). 

As per claims 24, 10, 48 and 77 recites similar limitations as claim 1 above 
and similarly analyzed except for the step as taught by Shenghua at et a three 
dimensional inspection method for ball array devices having a plurality of balls, the 
method comprising the step of: 

b) disposing a sensor to receive light at a first angle relative to the ball array 
device (page 731- 732); 

d) disposing a second optical element to receive light at a second angle different 
from the first angle and to transmit a second view of the ball array device to the sensor 
(page 731-732, Fig 1,2 and 3); 

f) processing the output using a triangulation method to calculate a three 
dimensional position of the at least one ball with reference to a pre-calculate calibration 
plane (page 731 page 731- 732), paragraph 1,2 system description and calibration 
model and paragraph 3, calibration and measurement experiments), use of processing 
the output using a triangulation method to calculate a three dimensional position of the 
at least one ball with reference to a pre-calculate calibration plane because to produce 
reasonable accuracy in 3-D inspection page 731, abstract paragraph). 

Therefore, it would have been obvious to one with ordinary skill in the art at the 
time of invention to incorporate the teaching the step of using processing the output 
using a triangulation method to calculate a three dimensional position of the at least one 
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ball with reference to a pre-calculate calibration plane as taught by Shenghua Ye et al 's 
into the system of Liu because one with ordinary skill in the art would realize that this 
modification would produce reasonable accuracy in 3-D inspection, as suggested by 
Shenghua at et. ( page 731, abstract paragraph). 

2. Claims 31 , 33, 44, 55 and 80 are rejected under 35 U.S.C. 103(a) as being 
unpatentable over Liu et al. (US. 5,859,924) In view of Shenghua Ye et al. " Vision - 
based system calibration for dimensional inspection ", as applied to the above claims 1- 
29, 31 , 33-53, 55-60, 62- 88, and further in view of King et al. (US.6, 236, 747). 

Regarding claims 31,33, 44, 55 and 80 Liu discloses a method and system for 
measuring object features. Liu fails to specifically mention about illuminator comprises a 
ring light. However, King discloses system and method for image subtraction for ball 
and bumped grid array inspection where the ring illumination apparatus 20 includes a 
substantially ring -shaped light source 24 that generates light beams and directs the 
light beams into the field of view on the article, column 5, lines 41- 58). It would have 
been obvious to one with ordinary skill in the art at the time of invention to incorporate 
the teaching of an illuminator comprises a ring light as taught by King 's into the 
system of Liu. The motivation for doing so is to detect quickly and accurately 
absence/presence of the illuminated reflective elements, determines their position, and 
measures the size and shape, e.g. the diameter and circularity of any protruding object, 
if desired, as suggested by King at (column 3, lines 11-15). 
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As per claim 47, Liu discloses the three dimensional inspection method wherein 
the second optical element reflects a view to the sensor where at least one ball of the 
ball array device exhibits a crescent shape (column 2, lines 10- 22). 

As per claim 48, the same limitations as set forth in claim 24 are contained as an 
independent claim (refer to claim 24, for common features) except for step of claim 48, 
recites f) processing the image information by applying triangulation calculation 
measurements of the image information so as to a three dimensional position of at least 
one ball with reference to a pre-calculated calibration plane, wherein the calibration 
plane comprises a coordinate system having X,Y and Z axes, and wherein an X 
measurement value is proportional to a Z measurement value ( page 731-732 , 
paragraph 2 system description and calibration model and paragraph 3, calibration and 
measurement experiments ). 

As to claim 69 is representative of claim 48. 

As to claim 70, is representative of claim 1 . 
3. Claims 8, 30 and 61 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Liu et al.(US.5,859,924) in view of Shenghua Ye et al. " Vision -based system 
calibration for dimensional inspection ", in view of King et al.(US.6, 236, 747), as applied 
to the above claims 1- 7, 9-29, 31, 33-53, 55-60, 62-88, and further in view of Svetkoff 
etal. (US. 5,617,209). 

Q 

Regarding claims 8, 30 and 61, Liu discloses method and system for measuring 
object features. Liu fails to teach the optical element comprises a prism. However, 
Svetkoff discloses method and system for triangulation -based, 3-D imaging utilizing an 
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angled scanning beam of radiant energy. The system comprises of a three dimensional 
inspection method wherein the second optical element (note, fig 8 consists of optical 
system, comprises a prism (column 1 1 , lines 21- 26), use of optical device such as 
prism, because the system provides a method which improves the reliability and 
accuracy of the measurement system by providing a consistent lead orientation, thereby 
alleviating data reduction requirements (column 6, lines 19- 23). 

Therefore, it would have been obvious to one with ordinary skill in the art at the 
time of invention to incorporate the teaching of step wherein the optical element 
comprises a prism as taught by Svetkoff s into the system of Liu because, one with 
ordinary skill in the art would realize that it improves the reliability and accuracy of the 
measurement system by providing a consistent lead orientation, thereby alleviating data 
reduction requirements, as suggested by Svetkoff at (column 6, lines 19- 23). 
4. Claims 32 and 54 are rejected under 35 U.S.C. 103(a) as being unpatentable 
over Liu et al. (US.5,859,924) in view of Shenghua Ye et al. " Vision -based system 
calibration for dimensional inspection ", in view of King et al. (US.6, 236, 747), in view of 
Svetkoff et al., (US. 5,617,209), as applied to the above claims 1- 31 , 33 - 53, 55-88, 
and further in view of Roy et al., (US. 6,1 18,540). 

Regarding claims 32 and 54 Liu discloses method and system for measuring 
object features. Liu fails to teach step of illuminating with a plurality of light emitting 
diodes. However, Roy discloses method and apparatus for inspecting a work piece. The 
system comprises of the three dimensional inspection method wherein the step of 
illuminating comprises the step of illuminating with a plurality of light emitting diodes 
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(column 2, lines 52- 63), use of plurality of light emitting diodes, because to provide 
appropriate coverage of the object (column 2, lines 52- 63). 

Therefore, it would have been obvious to one with ordinary skill in the art at the 
time of invention to incorporate the teaching of step of illuminating with a plurality of light 
emitting diodes as taught by Roy's into the system of Liu because, one with ordinary 
skill in the art would realize that having more light emitting diodes can provide an 
appropriate coverage of the object, as suggested by Roy at (column 2, lines 52- 63). 
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Contact Information 



5. Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Sheela C Chawan whose telephone number is 703- 
305- 4876. The examiner can normally be reached on Monday - Thursday 6-7. 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Bhavesh Mehta can be reached on 703-308-5246. The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 

Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 



Sheela Chawan 
Patent Examiner 
Group Art Unit 2625 
April 16, 2004 




Jayanti K. Patel 
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